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Abstract 

This study examines a new formulation of non-equilibrium thermodynamics, which gives a conditional derivation of the "max- 
C\| imum entropy production" (MEP) principle for flow and/or chemical reaction systems at steady state. The analysis uses a dimen- 
^^sionless potential function 4>st for non-equilibrium systems, analogous to the free energy concept of equilibrium thermodynamics. 
Spontaneous reductions in 0„ arise from increases in the "flux entropy" of the system - a measure of the variability of the fluxes 
'- or in the local entropy production; conditionally, depending on the behaviour of the flux entropy, the formulation reduces to the 
MEP principle. The inferred steady state is also shown to exhibit high variability in its instantaneous fluxes and rates, consistent 
with the observed behaviour of turbulent fluid flow, heat convection and biological systems; one consequence is the coexistence of 
energy producers and consumers in ecological systems. The different paths for attaining steady state are also classified. 
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Sinc e the seminal book "What is Life" by Erwin lSchrodinger 



j 19441) . scientists have pondered the existence of life and its 
compatibility with the second law of thermodynamics. Ridicul- 
■ing the popular notion that the primary purpose of biological 
metabolism is to extract matter and energy from the environ- 
ment, he moves to the crux of the issue (p 71): 

"... a living organism continually increases its en- 
tropy ... and thus tends to approach the dangerous 
state of maximum entropy, which is death. It can only 
keep aloof from it, i.e. alive, by continually drawing 
from its environment negative entropy ... What an or- 
ganism feeds upon is negative entropy." 

(The argument is qualified in a footnote, to refer to free en- 
ergy instead of negative entropy . ) The topic was taken up in 



more detail by 



Prigogind (11967 



1980), who described hving 



organisms - along with heat-transporting convection cells, tur- 
bulent fluid flow vortices and oscillatory chemical reactions - 
as dissipative structures, which continually dissipate heat and 
thus generate and export entropy to the environment. How- 
ever, Prigogine's main quantitative result, his minimu m entropy 



production (MinEP) principle - valid in the linear or lOnsager 



(1193 



[a) transport regime - seems diametrically opposed to 



life ( Martvushev et al. 



20071) . as was recognised by 



Prigogine 



(Il980l p88) himself. Bacteria in a microcosm, organisms in 
an ecosystem or humans on a planet do not try to minimise 
their entropy production, but instead grow, reproduce and con- 
sume all available resources as rapidly as possible. More re- 
cently, other thermodynamics-inspired perspectives on biolog- 
ical systems have been advanced, including the use of biolog- 



ical measures of entropy and information (e.g. 



the no n-mathematical gradient theory of 



Avres , 



1994); 



Schneider & Sagan 



(l2005h : and ex ergy-based treatm ents of ecological systems and 



processes (e.g. 



J0rgensen , 



2000) . 
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Over the past 30 years, a new principle has been pro- 
posed, the maximum entropy production (MEP) principle, 
which states that a flow system subject to various flows or 



imum thermodynamic entropy production, & ( 


Ozawa et al. 


2003; 


Kleidon & Lorenz , 2005 


Martvushev & Seleznev 


2006 


Bruer 


s, 


2007c 


). The MEP principle has been success- 



fully applied - in a heuristic sense - to the prediction of 
steady states of a wide ra nge of systems , incl u ding the 



Earth ' s chmate system (e.g. 



2004 



Kleidon & Lorenz , 



( Ozawa et al 



1981 



2004 



2001 



Lorenz , 



Paltridge , 



1975 



1978 



Kleidon , 



20051) : thermal ( Benard) convection 



); mantle convection (iVanvo & Paltridge . 



Botric et al 



2001h: electrical currents dZupanoyic et al 



2005 



plasmas (iChr 



sten , 



Christen , 



2007 



1 



2006 



Bruers et al. 



Yoshida & Mahaian . 



talhne solids JMartvushev & Axelrod 



ecological sys tems dMevsman & Bruers , 



cal processes (IJuretic & Zupanovic 



2003 



Christen , 



2007al) : 



2008 ); crys 



2007bh : 



2007 ) and biochemi- 



Dewar et al 



20061) . 



The MEP principle therefore offers a new approach for the anal- 
ysis of biological systems at the cellular, organism, ecosystem 
and biosphere levels. Most importantly, it is a quantitative prin- 
ciple, based on precisely defined, rigorous thermodynamic con- 
cepts; it does not rest upon vague, non-mathematical notions 
such as "order", "disorder", "randomness" or "complexity" of- 
ten seen in discussions of biological systems. 

Several theoretical justifications of the MEP principle have 
been advanced, incl uding approach e s based on pa t h or tra n- 



sition probabihties dDewai 



2003 



2005 



and two more gen eralistic arguments (IZupanovic et al 



Attard , 



2006allb) 



1 



2006 



Martvushev 



20071) . Recently, a rather different derivation was 
presented to directly determine the steady state of a flow system, 
based on an entropy defined on the set of local instantaneous 
fluxes and reaction rates through or within each infinitesimal el- 
ement; this red uces to a local fo rm of the MEP principle in some 



circumstances (Niven, 



2009bl) . The analysis invokes a gener- 
alised potential function (negative Massieu function) obtained 
from Jaynes' maximum entropy method, somewhat analogous 
to the free energy concept used in equilibrium thermodynam- 



ics, which attains a minimum at steady state. The aim of this 
study is to explore the implications offliis derivation in some- 
what simpler terms than in iNivenI (l2009bl) . using terminology 



adapted from chemical and statistical thermodynamics. In par- 
ticular, the nature of the inferred steady state of a flow system, 
and the various means by which it can be attained, are examined 
in detail. The analysis has important implications for the mod- 
elling of flow systems, including the Earth's climatic-biosphere 
system and all biological systems. 

2. The Generalised Free Energy Concept 

2.1. Jaynes' MaxEnt 



Th e max imum en tropy (MaxEnt ) principle of 



1963 



2003 



see also 



Tribus , 



1961 



Jb; 



Javnes 



Kapur & Kesavan , 



1957 



1992) 



provides a powerful technique with which to infer the most 
probable position of a probabilistic system. Consider a system 
composed of distinguishable entities allocated to s eq uiprob- 



able, distinguishab l e categ o ries (a multinomia l 



2005 



2006 



2007 



2009a; 



Niven & Grendar 



system : 



Niven , 



2009). In flie 



asymptotic limit N ^ co, the most probable position can be 
obtained by maximising the r elative entropy function (th e neg- 



ative of the Kullback-Leibler 
tion, D): 



KuUback & Leibled (119511) func 



(1) 



where is the probability of an entity in the /th category and qt 
is the source or "prior" probabilit y of category F or equiproba- 



ble categories, this reduces to the 
tion: 

s 

^sh = - ^ In Pi 



Shannonl(ll948l) entropy func- 
(2) 



plus a constant. Eq. ([TJ (or (|2]i) is maximised subject to the nat- 
ural (normalisation) and any moment constraints on the system: 



2^ 

1=1 



1, 



(3) 
(4) 



1=1 



where /„ is the value of the ith category of property /,• and (/, ) 
is the expectation (average) of /„ . This yields the most probable 
(stationary) distribution of the system: 

R R 



p* = ^, exp(-4 - Arfri) = (Z*) Viexp(- ^ i,/„), 



)■=! 



(5) 



Z* = qi exp(^o) = ^ exp(- ^ AJri), 



and the maximum entropy position dJavnes , 

R 



1957 



1963 



2003): 



9f ^Xl+Yj^r{fr). 



(6) 



where i s the rth Lagrangian multiplier, /ly is the "Massieu 



function" (IMassieu . 



18691), Z* is the partition function and an 



asterisk denotes the stationary position. It is emphasised that 
the above derivation is generic, and applies to any probabilistic 
system of multinomial form; it need not refer to a thermody- 
namic system. 

2.2. Generalised Heat, Work and Potential Function 

We now consider any conserved quantity /,., for which we 
adopt the definition: 



d{fr) = 6Wr + 6Qr 



(7) 



where the path differentials 6Wr = Tj^i P^dfn and 6Qr = 
Tii=i dp'fri can be termed the "generalised work" and "gener- 
alised heat " associated respectively w ith a change in (fr). It can 



be shown (IJavnes , 



1957 



1963 



2003) that: 



r=l 



(8) 



Clausius, 



1865) 



This is a "generalised Clausius equality" (c.f 
applicable to all multinomial systems. Substituting dHJ into the 
differential of (|6]i and rearranging gives: 

R R 



(9) 



We therefore obtain a potential function (f> (negative Massieu 
function) which captures all possible changes in the system. 



due to changes in the entropy Sj* or in the "constraint set" 
Tir=i {fr}- If the multipliers {Ar] are constant, d(p reduces 
to the multiplier-weighted total generahsed work on the sys- 
tem, ArdWr- We therefore see that (f> is a dimensionless, 
weighted, extended version of the free energy functio n, appli- 
cable to any probabilistic system of multinomial form dJavnes 



1957 



1963 



2003 



Tribus . 



1961allbh . 



I 



How should we interpret (|9]l? Consider some form of "open 
system", consisting of a defined region or collection of discrete 
entities in contact with some surroundings (or the rest of the 
universe). The internal structure of the system may be described 
by some probability function giving rise to some relative en- 
tropy function for the system (not necessarily the thermody- 
namic entropy S , but any entro py). From a pu rely probabilistic 



formulation of the second law (INiven , 



2009allbh : 



1 



"The entropy of the universe, io„ 
can only increase ", 



however defined. 



it is evident that any spontaneous event must result in an in- 
crease of the entropy of the system, ST, and/or an increase in 
entropy produced and exported by the system to its surround- 



ings, S^prod- Quantitatively, this can be written a; 

dSjuniv = dSj* + SSjprod > 



(10) 



However, the only means by which a system can produce and 
export entropy - thereby increasing SSOprod - is by a reduction in 
the magnitude of one or more constraints (or multipliers) which 
govern the system, {{fr}] (or {Ar]). For such a change to give 
rise to a quantity in (dimensionless) entropy units, we therefore 
establish that dSjprod - -^(lif=i ^rifr})- Comparing (|9]l and 
JTOl i. we thus see that dip expresses, in a negative sense, the 
change in entropy of the universe. This can be written as: 



d^ 



(11) 



-dSj* - 6 S) prod < 

Eqs. (|9]l and (fTTT i thus provide a mathematical formulation of a 
generalised second law (with sign reversed), expressing the in- 



Technically, the variation in Sjprod i.s written witli a S, since it is a "non- 
property" of tlie system; liowever, for a reproducible phenomenon, it will be 
expressible in terms of other state functions of the system. 



terplay between changes in the entropy - however defined - of 
a system, and changes in entropy produced and exported by a 
system to its surroundings. This is again consistent with the in- 
terpretation of as a dimens ionless, weigh t ed, extended version 



of the free energy concept (IJaynes . 



1957 



1963 



2003 



Tribus . 



1961a b) 



3. Applications 

3.1. Equilibrium Systems Example 

The above discussion is best illustrated by an example from 
thermody namics. Whilst a broader free energy concept is con- 
sidered in 



with the 



Niven 



(2009b), most readers will be more familiar 



Gibbsl (11875-781) free energy function for systems of 



constant composition: 

G = -TS* + U + PV = -TS* + H, 



(12) 



where 5 * is the maximum thermodynamic entropy, U is inter- 
nal energy, V is volume, P is pressure, T is absolute tempera- 
ture and H is the enthalpy. Eq. (fT2l i can be derived by applying 
Jaynes' method to an equilibrium thermodynamic system sub- 
ject to the constraints U and V, wherein /:>, is the joint probabil- 
ity that a molecule will occupy a specified energy level and vol- 



ume element. Eq. ([ 


p then g 


1957 


1963 


Tribus , 


196lJb 



Jaynes, 



2003) 



dSjlg + d{AuU + AvV) 



(13) 



Recognising S* - kSj*^, Au - l/kT and Ay - P/kT, where k is 



Boltzmann's constant, gives: 
kd<p, 



d{^)^-dS*+d{^)<0 (14) 



equivalent to (fT2l l. This form reveals the true meaning of the 
Gibbs free energy concept: it expresses - in a negative sense 
- the interplay between the change in entropy within the sys- 



tem, dS*, and the change in entro 
-d(H/T), due to transfers of heat ( 


py exported by the system, 


Planck 


1922, 


1932 


Fermi 


1936 


Strong & Halhwell 


1970 


CraiJ 


1984- From the (clas- 



sical) second law, their sum must be positive, and so a system 



will spontaneously approach a position of minimum G/T (for 
constant T, it will approach m inimum G). From ( fTTI ). we can 



rewrite (fT4l) as dNiven , 



2009b): 



kd(peq - ^{'^) - -dS* - So- <0 



(15) 



where 6cr = k5S}prod is the increment of thermodynamic entropy 
produced and exported by the system to its surroundings. 

3.2. Flow System Example 

Now consider a second example, of an infinitesimal fluid el- 
ement in a control volume of a flowing fluid, subject to local 
mean values of the heat flux Jq, diffusive mass fluxes of each 
chemical species c, stress tensor r and chemical reaction rates 

of each reaction d, plus the natural constraint (O. This model 
encompasses all biological and ecological systems. Such a sys- 
tem can be anal ysed by Jayne s' method using the local flux 



relative entropy (INiven . 



2009bh : 



(16) 



where tt/ is the joint probability that the fluid element expe- 
riences a set of instantaneous local fluxes of heat, species c, 
momentum and rates of chemical reactions d, and ji is the joint 
prior probability. For this system, it can be s hown that (|9t g ives 



the increment in the local potential function (INiven , 



d<ps, - -dSj, 



-6&<Q 



2009bh : 
(17) 



where i^*, is the local flux entropy at steady state, 6 and "V are 
characteristic time and volume scales of the system, and & is 
the local thermodynamic entropy production of the element per 
unit volume: 

(18) 



c ^ 

[t) "Zi^'^Y 



-T : Vi 



in which //^ , Mc and are the molar chemical potential, molar 
mass and specific body force on species c, v is the mass-average 
fluid velocity and is the molar chemical affinity of reaction 



d, with Ad < Q indicating spontaneous forwards reaction. Eq. 
( fTSl ) can be summarised in the form: 



2 ixFx 

X 



(19) 



where jx is the local mean flux or mean reaction rate of quan- 
tity or species X, and Fx is the corresponding local "thermo- 
dynamic force" (gradient or affinity term). Not coincidentally, 
( fTTI l has the same form as (fTTT i. expressing (with sign reversed) 
the sum of changes in the flux entropy within the element plus 
its export out of the system. A flow element will therefore 
try to approach a steady state position of minimum 0,^/, for the 
same reason that an equihbrium thermodynamic system tries to 
approach an equilibrium position of minimum (p^q (minimum 
GIT). 

Comparing (fT4l l and ( fTTl l. we see that the entropy production 
& within a fluid element of a steady state system plays a simi- 
lar role (with change of sign and units) to the enthalpy function 
H in equilibrium systems. This is an important insight, which 
has perhaps been hindered by the l ack of popular unde r stand- 



ing of the fr ee energy concept (see 



Strong & Halhwell . 



1970; 



Craiglll988h . The common feature is that H and & both serve 
as (modified) measures of the export of entropy - however de- 
fined - by a system to its surroundings. Many previous authors 
have erred in considering & to be the non-equilibrium analogue 
of S*; whilst this may seem reasonable at first glance, it is not 
correct. 

4. Implications 

4.1. Meaning of the Flux Entropy 

To understand (fTTT i. it is necessary to appreciate the mean- 
ing of the flux entropy i^*,. To do this, we need to consider 
the mathematical proper ties of the Shannon entropy ^ (e.g. 



Kapur & Kesavan , 



1992 



chap. 2). In essence, indicates the 
spread of the distribution /:>, amongst its categories /; the ther- 
modynamic entropy S * therefore reflects the spread of the equi- 
librium distribution p* over energy levels and volume elements, 
with low S* indicating a narrow distribution and high S* a 



broad one. In the same way, Sj*, reflects the spread of the steady 
state probability ttJ over the set of instantaneous local fluxes and 
reaction rates. This is illustrated by the schematic plots in Fig- 
ures[lH-c, for a univariate parameter I - I (e.g., a single flux or 
reaction rate of quantity X). All three plots have the same mean 
flux or rate jx - represented schematically by a fixed "mean 
category" /q - but the variance, and therefore the flux entropy, 
increases to the right. 

The plots reveal an additional, extraordinary feature of flow 
systems. In equilibrium systems, the categories (e.g. energy 
levels) are generally taken to start from a "zero" or reference 
level, for which the value of the index is unimportant. In con- 
trast, flow systems have no such minimum, since we must allow 
for positive and negative flux or rate levels / = 0, +1, +2, .... In 
consequence, as Sj*, increases, the system is more likely to ac- 
cess its states of reverse flow or reverse chemical reaction / < 0, 
even if the mean value jx is high (see Figures [ll)-c). In other 
words, a high flux entropy is associated with greater variability 
in the fluxes and rates, which therefore implies oscillatory or 
chaotic processes. We immediately see the connection between 
steady states of high Sj*, and the defining features of many 
"far from equilibrium" systems, such as fluid turbulence, heat- 
induced convection cells, non hnear difiiision phenom ena and 



oscillatory chemical reactions (IPrigogine 



1967 



19801) : indeed. 



the latter are prevalent in b iochemical processes such as nutri 



ent degradation proc esses (IMevsman & Bruers , 



photo synthesis cycle (IJuretic & Zupanovic 



2003 



2007) and the 



Dewaretal 



2006h . 

The importance of above analysis can be illustrated by its ap- 
plication to the species population structure within an ecosys- 
tem. Consider a small element of a (rudimentary) ecosys- 
tem of s species, identified only by their energy usage, such 
that each organism of species / has the energy consumption 
€i, whilst the system has mean energy consumption (E). This 
model dr amatically simp li fies th e MaxEnt ecosystem model 
given by Dewar & Porta (l2008h . To infer the steady state 
population distribution n*, we maximise the relative entropy 
^ecoi - -YjUi^i 1" ^i/7i CSJ' subjcct to kuowu prior probabil- 





(a) 



sf1 



7t 



/n 




(b) 



/n 



/ 



''I 


(c) 



I 



.^*s/3>-*5*s/2 



/n 



Figure 1: Effect of increasing on a univariate steady-state distribution (scliematic only). 



ities ji and constraints Yfi=\ - 1 ^^^j 7r,e,- = (E), giving 
TT* = Z"'y/exp(-^£ei) 

S 



(20) 



(=1 



where and are, respectively, the Lagrangian multipliers 
for the two constraints, and Z is the partition function. The 
analysis (fT7]l-(fT9]l then follows from ( l20l l. with the energetic 
multiplier identified as cc Fe = Vr Although (l20l l has the 
appearance of a Boltzmann distribution akin to that of chemi- 
cal thermodynamics, in an ecosystem the "energy levels" / are 
actually "energy consumption levels", which can be positive or 
negative, corresponding respectively to net energy consumers 
(i > 0) and net energy producers (i < 0). At a high ecological 
flux entropy the "most probable" ecosystem will there- 

fore be forced to contain both energy producers and consumers, 
rather than just energy consumers. Similarly, in turbulent fluid 
flow, some energetic structures will be net energy consumers 
(dissipating energy as heat), whilst others will be net energy 
producers (transferring energy from its incoming source to the 
consumers). We therefore recover the essence of the ubiqui- 
tous "food chain" (or "food web") of ecological systems and 
the "energy cascade" of turbulent flow systems. 

4.2. Classification of Spontaneous Processes 

We can now return to the equilibrium (fT4l i and steady state 
( fTTl l potential functions. For simplicity, we first confine the dis- 
cussion to processes with monotonic changes in the entropy S * 
and entropy produced cr - -H/T. We see that in equilibrium 
systems, the path towards equilibrium dip^g < will depend 



on the relative changes in S* and cr, leading to three possi- 
ble scenarios for a spontaneous process, as listed in Table [U 
In Case El, the process is driven by changes in both entropy 
terms, whilst in Cases E2 and E3, a reduction in one entropy 
is "paid for" by a greater and opposite gain in the other. In 
all cases, since the entropy changes are monotonic, the equiUb- 
rium position (minimum <peg - minimum G/T) must coincide 
with extrema (a minimum or maximum) in both S * and cr, as 
set out in the Table. 

Similarly, from (fTTT l. in a flow system subject to monotonic 
changes in Sj*, and &, each increment towards steady state 
dips! < could be achieved by one of the three cases listed 
in Table [1] The corresponding extrema at steady state are also 
listed. As shown. Cases SI and S3 are consistent with a posi- 
tion of maximum entropy production (MEP). Case S2, on the 
other hand, involves convergence towards a position of min- 
imum entropy production (MinEP). The three cases therefore 
encompass the two major (seemingly contradictory) principles 



of non-equilibrium ther modynamics (iPrigogine . 



Martvushev et al 



1967 



1980; 



20071). 

We further note that if passage to equilibrium or steady state 
is not monotonic, many more scenarios are possible. In thermo- 
dynamics, this is handled by considering only the net change in 
Gibbs free energy AG = -TAS* + AH at constant T and P. In 
light of (fl4l l. this is more appropriately written as: 

kA<p,, = a(|) = -AS* + a(|) < (21) 

This rests on the fact that G, S*, U,V and H are state functions, 
so we can disregard the path taken by the system. Although 
such systems could follow any of the paths E1-E3 in Table [T] 



Table 1 : List of possible spontaneous processes in equilibrium and stea dy state systems , for monotonically varying parameters (terminology from ancient Greek: 
exo-, external; endo-, internal; pan-, everywhere; tropos, transformation )Clausiusl , ll865l) and -genie, generating or producing). 



Case Conditions Entropic Driving Force Label Extrema at Stationary Position 



Equilibrium systems {kd(peg 


- d(G/T) < 0) 












El dS* > 0, 


6cr>0 


universal 


panentropic 


max 5*, 


max cr {- 


min ///T) 


E2 dS* > \6cr\ > 0, 


6cr <0 


internal dominant 


endoentropic 


max S*, 


min cr {- 


max HIT) 




OCT > 1 > U 


external dominant 


exoentropic 


min o , 


max cr (= 


nun tij 1 ) 


Steady state systems (Kdcpst 


< with K = kie^) 












SI dSj*„>0, 


6cr>Q 


universal 


panentropogenic 


max i^*,, 


max & 




S2 KdS);, > \6o-\ > 0, 


5cr<Q 


internal dominant 


endoentropogenic 


max 


min & 




S3 dSj*„ < 0, 


do- > \KdSj1,\ > 


external dominant 


exoentmpogenic 


min 


max & 






Figure 2; Possible responses of a flow system to an increasing force Fx or mean flux jx (increasing /q); (a)-(b)-(c) constant j^*, or (a)-(d)-(e) increasing Jj*, 



during different stages of the process - or even temporarily de- 
viate from d(G/T) < to overcome an activation energy barrier 
- they must approach a position of minimum G/T, leading to 
a net change A{G/T) < 0. The system can still be said to fol- 
low one of Cases E1-E3, but now only in a net sense (using A's 
rather than t/'s). In Case E3, for example, we can still speak of 
the system tending towards a position of minimum S * and max- 
imum cr (= minimum HIT), provided this is understood to refer 
to their net changes rather than the path taken by the system. 

In a similar vein, if an unsteady flow system is not restricted 
to purely monotonic changes, it must still approach a steady 



state position of minimum i^*,, and thus undergo the net change 
Ai5s, - 0- Presuming that S)*, and & can be considered as state 
functions, the system can still be identified as following - now 
in a net sense - one of the three Cases S1-S3 in Table[I] 

Can we infer anything more about flow systems? Indeed, 
we can. Consider a flow element which experiences a grad- 
ual increase in the local thermodynamic force Fx conjugate to 
the mean local flux or rate jx- Such an element may undergo 
two types of changes: (i) an increase in jx without any cor- 
responding increase (or even a decrease) in i]*,, illustrated in 
Figures|2^-b-c; and (ii) increases in both jx and i^*,, illustrated 



7 



in Figures |2^-d-e. From ( fTSl ). both scenarios involve identical 
increases in the entropy production. Ad" - A{jxFx)- Which 
is more likely? From our knowledge of flow systems, the first 
scenario seems less credible, since it requires the fluxes to re- 
main within a narrow range of instantaneous values at all times, 
even though the driving force has increased. A decrease in 9)1, 
seems even more unlikely. The second scenario permits greater 
variability (fluctuations) of the fluxes, consistent with the for- 
mation of a non-linear mechanism to enable greater transport or 
production of X. A similar argument applies if the flux, rather 
than the gradient, is the control variable. Alth ough th i s is no t 



200%) 



a proof, it does lend support to the argument (INiven , 
that fluid elements tend to undergo concurrent increases in 9}*, 
and &, and thus converge to steady state by a (net) panentwpo- 
genic process. In such cases, the steady state position can be 
determined by the (net) MEP principle, without concern over 
contrary effects due to decreases in i^*,. 

5. The MEP "Heuristic" 

We now turn to a discussion of current practice in 
the application of the MEP principle to flow or chemi- 
cal reaction systems, inc luding biologica l syste ms. From 



the pioneering works of IPaltridge (11975 



decades of further experience (e.g. 



Bruers . 



Dewa 



2007c: 



etal 



Juretic & Zupanovic 
20051 



2003 



2006 



Kleidon , 



Ozawa et al 



2004 



1978) and three 



2001 



2003 



Kleidon & Lorenz , 



Martyushev & Seleznev 



Mevsman & Bruers 



2006 



2007), this has evolved into 



a set of practices which can be termed the "MEP heuristic": 

(i) Divide the control volume into very large subdomains (or 
even consider the entire domain); 

(ii) Set up the set of mass, chemical species, energy, mo- 
mentum and/or charge balance equations for the system, 
based on the bulk flow rates between subdomains, using 
linear (Onsager-like) transport equations with adjustable, 
whole-subdomain transport coefficient(s), and chemical 
reaction rate equations with adjustable first-order rate con- 
stant(s); 



(iii) Calculate the thermodynamic entropy production of the 
system, as a function of the adjustable parameter(s); 

(iv) The inferred steady state of the system is given by the 
position of maximum entropy production with respect to 
the adjustable parameter(s). 

How does this heuristic work? In effect, it selects the highest 
allowable entropy production consistent with the set of allow- 
able bulk net fluxes Jx,t and bulk thermodynamic forces Fx,t in 
and between subdomains F of the system: 



MEP. Heuristic = max ^ 2^ Jx.ri^) Fx.ri^) (22) 

where the bulk fluxes and/or forces are functions of the set of 
subdomain-wide adjustable parameters SI - It must be 

recognised, however, that the adjustable parameters are sec- 
ondary variables, which do not represent fundamental physical 
processes. The true maximum must therefore be given by a 
"system maximum entropy production" (SMEP) principle: 



SMEP = maxi 



/// 



&{V) dV 



(23) 



where the maximum is taken with respect to the instan- 
taneous fluxes jxj, conditioned by the constraints on the 
system, and the integral is calculated over the control vol- 
ume. The MEP heuristic therefore makes the assump- 
tion that (I22I) and ( |23] ) are equivalent, which is correct 
if and only if there exists a set of local physical mecha- 
nisms by which the maximum in ( |22] | can be physically re- 
alised. Using the terminology of MEP practitioners, the MEP 



degree-of-freedom" systems (e.g. 


Dzawa et al. 


, 2001 




2003 


Juretic & ZuDanovic 


2003 


Kleidon 


2004 ; Kleidon & Lorenz 


2005; 


Dewar et al.. 


2006 


; Martvushev & Seleznev 




2006 


Bruers , 


2007cl Mevsman & Bruersl 


2007). 







In contrast, the analysis herein (^2l|4]i and in 
gives the optimisation principle: 

Optimum = JJJ mm{^„{V))dV 

cv 



Niven (2009b) 



/ . 6'Vd-(y)x 



(24) 



If the parameters Sj*, and & are positively correlated - as argued 
in ^ - then {2M becomes functionally equivalent to a "local 
maximum entropy production" (LMEP) principle, which gives 
for the overall system: 



LMEP 



max d-iV))dV 



(25) 



cv 



This is a much stron ger condition than (1231 ). By considerations 



of integral calculus jZwillinger 



2003). the two bounds are re- 



lated by: 



max 



JJJ o-iV)dVj< JJJ max o-iV)dV (26) 



since the left hand side could possess regions of o" < 0, com- 
pensated by other regions of greater & > 0. This, how ever, runs 
against an argument used by [ 



Prigogind (11967 



198C): how can 



a system possibly "know" that it can consume entropy in some 
regions, which will be compensated by greater entropy produc- 
tion in others? Indeed, we could construct a smaller control vol- 
ume containing only the entropy-consuming elements, which 
would continuously violate the second law of thermodynamics. 
It is for this sound reason that the MEP principle must be a local 
principle, applicable at all volume scales. With the restriction 
cr(V) > 0, we see that the two maxima in (|26] | coincide, and 
so the MEP heuristic (with its assumption of many degrees of 
freedom) becomes equivalent to the local formulation. 

6. Conclusions 

This study examines the meaning and impUcations of a new 
formulation of non-equilibrium thermodynamics applic able to 



flow an d/or chemical reaction systems at steady state (INiven , 



2009bl) . This provides a very different, conditional derivation 
of the "maximum entropy production" (MEP) principle, based 
on minimisation of a dimensionless, local, free-energy-like po- 
tential function 0^,. The analysis encompasses all biological 
and ecological systems. Fkstly, the basis of the derivation and 
the meaning of (pst are examined. The flux entropy Sj*, used in 
the analysis is then shown to represent the "spread" of the dis- 
tribution of instantaneous fluxes and/or reaction rates through 



or within the element. Since a flow system can access states 
of reverse flow or reaction, a high flux entropy is consistent 
with higher variability and thus with chaotic or oscillatory pro- 
cesses. In this respect, the term "steady state" is therefore some- 
thing of a misnomer, since it refers only to the constancy of the 
mean bulk flows and not their temporal and spatial variability. 
One consequence, examined through a specific example, is the 
coexistence of energy producers and consumers in ecological 
systems. 

The effects of reinforcement or competition between changes 
in flux entropy Sj*, and entropy production & are then examined 
and classified. It is argued that in many systems, these two pa- 
rameters should increase concurrently, enabling the steady state 
position to be determined by the MEP principle. The "MEP 
heuristic" used by MEP practitioners is then shown to be con- 
sistent with the present local formulation, with the additional 
assumption that the system has suflicient dynamic degrees of 
freedom that the MEP state can be physically realised. 

Acknowledgments 

The author thanks the participants of the MEP workshops 
hosted by the Max-Planck-Institut fiir Biogeochemie, Jena, 
Germany, in 2007 and 2008, for valuable discussions; The Uni- 
versity of New South Wales and the above Institute for financial 
support; and the European Commission for financial support as 
a Marie Curie Incoming International Fellow (2007-2008) un- 
der Framework Programme 6. 

References 

Attai'd P. (2006), Statistical meclianical theory for steady state systems. VI. 

Variational principles, J. Chem. Phys. 125: article 214502. 
Attard, P. (2006) Theory for non-equilibrium statistical mechanics, Phys. 

Chem. Chem. Phys. 8: 3585-3611. 
Ayres, R.U. (1994) Information, Entropy and Progress, AIP, Woodbury, NY. 
Benard, H. (1901) Les tourbillons cellulaires dans une nappe liquide trans- 

portant de la chaleur par convection en regime permanent, Ann. Chim. Phys. 

23: 62-144. 

Botric, S., Zupanovic, P., Juretic, D. (2005) Is the stationary current distribution 
in a linear planar electric network determined by the principle of maximum 
entropy production?, Croatica Chemica Acta 78(2): 181-184. 



Bruers, S. (2007) Classification and discussion of macroscopic entropy produc- 
tion principles, arXiv:cond-mat/0604482 /3. 
Bruers, S., Maes, C, Netocny, K. (2007) On the validity of entropy production 

principles for linear electrical circuits, J. Stat. Phys. 129: 725-740. 
Christen, T. (2006), Application of the maximum entropy production principle 

to electrical systems, J. Phys. D: Appl. Phys. 39: 4497-4503. 
Christen, T. (2007a), A maximum entropy production model for Teflon ablation 

by arc radiation, J. Phys. D: Appl. Phys. 40: 5719-5722. 
Christen, T. (2007b)Modelling diffusion in nonuniform solids using entropy 

production rate, J. Phys. D: Appl. Phys. 40: 5723-5726. 
Clausius, R. (1865) Uber verschiedene fiir die Anwendung bequeme Formen 

der Hauptgleichungen der mechanischen WLrmetheorie, Poggendorfs An- 

nalen 125: 335-400. 
Craig, N.C. (1988) Entropy analysis of four familiar processes, J. Chem. Ed. 

65(9): 760-764. 

Dewar, R.C. (2003) Information theory explanation of the fluctuation theo- 
rem, maximum entropy production and self-organized criticality in non- 
equilibrium stationary states, J. Phys. A: Math. Gen. 36: 631-641. 

Dewar, R.C. (2005)Maximum entropy production and the fluctuation theorem, 
J. Phys. A: Math. Gen. 38: L371-L381. 

Dewar, R.C, Juretic, D., Zupanovic, P. (2006)The functional design of the ro- 
tary enzyme ATP synthase is consistent with maximum entropy production, 
Chemical Physics Letters 430: 177-182. 

Dewar, R.C, Porte, A. (2008)Statistical mechanics unifies diff'erent ecological 
patterns, J. Theor Biol. 251: 389-403. 

Edelstein-Keshet, E. (1988) Mathematical Models in Biology, SIAM, Philadel- 
phia, PA, USA. 

Fermi, E. (1956)Thermodynamics. Dover Publ., NY. 

Gibbs, J.W. (1875-78) On the equilibrium of heterogeneous substances. Trans. 
Connecticut Acad. 3 (1875-1876) 108-248; (1877-1878) 343-524. 

J0rgensen, S.E. (2006) Eco-Exergy as Sustainability, WIT Press, Southhamp- 
ton, UK. 

Jaynes, E.T. (1957), Information theory and statistical mechanics. Physical Re- 
view, 106: 620-630. 

Jaynes, E.T. (1963), Information theory and statistical mechanics, in Ford, K.W. 
(ed), Brandeis University Summer Institute, Lectures in Theoretical Physics, 
Vol. 3: Statistical Physics. Benjamin-Cummings Publ. Co., 181-218. 

Jaynes, E.T. (G.L. Bretthorst, ed.) (2003) Probalnlity Theory: The Logic of 
Science, Cambridge U.P., Cambridge. 

Juretic, D., Zupanovic, P. (2003) Photosynthetic models with maximum entropy 
production in iireversible charge transfer steps, Computational Biology and 
Chemistry 27: 541-553. 

Kapur, J.N., Kesevan, H.K. (1992) Entropy Optimization Principles with Ap- 
plications, Academic Press, Inc., Boston, MA. 

Kleidon, A. (2004) Beyond Gaia: thermodynamics of life and Earth system 
functioning. Climatic Change 66: 271-319. 

Kleidon, A.. Lorenz R.D. (2005) (eds.) Non-equilibrium Thermodynamics and 
the Production of Entropy: Life, Earth and Beyond, Springer Verlag, Hei- 



delberg. 

Kullback, S., Leibler, R.A. (1951) On information and sufficiency. Annals 
Math. Stat. 22: 79-86. 

Lorenz. R.D. (2001) Of course Ganymede and Callisto have oceans: Applica- 
tion of a principle of maximum entropy production to icy satellite convec- 
tion, Proc. Lunar Planet Sci. Conf, 32: abstract 1160. 

Martyushev, L.M. (2007) Do nonequilibrium processes have features in com- 
mon?,larXi v:0709.0152V l. 

Martyushev, L.M., Axelrod. E.G. (2003) From dendrites and S-shaped growth 
curves to the maximum entropy production principle, JETP Letters 78(8): 
476-479. 

Martyushev, L.M., Seleznev, V.D. (2006) Maximum entropy production princi- 
ple in physics, chemistry and biology. Physics Reports 426: 1-45. 

Martyushev, L.M., Nazarova, A.S., Seleznev, V.D. (2007) J. Phys. A: Math. 
Theor. 40: 371-380. 

Massieu, M. (1869) Thermodynamique - Sur les fonctions caracteristiques des 
divers fluides, Comptes Rendus 69: 858-862; 1057-1061. 

Meysman, F.J.R.. Bruers, S. (2007) A thermodynamic perspective on food 
webs: Quantifying entropy production within detrital-based ecosystems, J. 
Theor. Biol. 249: 124-139. 

Moran, M.J., Shapiro, H.N. (2006), Fundamentals of Engineering Thermody- 
namics, 5th ed., John Wiley, NY. 

Niven, R.K. (2005), Exact Maxwell-Boltzmann, Bose-Einstein and Fermi- 
Dirac statistics, Physics Letters A, 342(4): 286-293. 

Niven, R.K. (2006), Cost of s-fold decisions in exact Maxwell-Boltzmann, 
Bose-Einstein and Fermi-Dirac statistics, Physica A. 365(1): 142-149. 

Niven, R.K. (2007) Origins of the combinatorial basis of entropy, in Knuth, 
K.H., Caticha, A., Center, J.L.. Giffon, A., Rodrguez. CC (eds), MaxEnt07, 
AIP Conference Proceedings 954, Melville, pp 133-142. 

Niven, R.K. & Grendar, M. (2009) Generalized classical, quantum and inter- 
mediate statistics and the Polya urn model. Physics Letters A 373: 621-626. 

Niven, R.K. (2009a) Combinatorial entropies and statistics, European Physics 
Journal B 70: 49-63. 

Niven, R.K. (2009b) Steady State of a dissipative flow-controlled system and 
the maximum entropy production principle, Phys. Rev. E, in press; see 
http://arxiv.org /abs/0902. 1568 

Onsager, L. (1931a) Reciprocal relations in irreversible processes 1, Phys. Rev. 
37: 405-426. 

Onsager, L. (1931b) Reciprocal relations in irreversible processes II, Phys. Rev. 
38: 2265-2279. 

Ozawa, H., Shikokawa, S., Sakuma, H. (2001) Thermodynamics of fluid turbu- 
lence: A unified approach to the maximum transport properties, Phys. Rev. 
E 64: article 026303. 

Ozawa, H., Ohmura, A., Lorenz. R.D., Pujol, T. (2003) The second law of 
thermodynamics and the global climate system: A review of the maximum 
entropy production principle. Rev. Geophys. 41: ailicle 4. 

Paltridge, G.W. (1975) Global dynamics and climate - a system of minimum 
entropy exchange. Quart. J. Royal Meteorol. Soc. 101: 475-484. 



Paltridge, G.W. (1978) The steady-state format of global climate. Quart. J. 

Royal Meteorol. Soc. 104: 927-945. 
Planck, M. (1922) Treatise on Thermodynamics, Engl, transl., 3rd ed., Dover 

Publications, NY. 

Planck, M. (1932) Introduction to Theoretical Physics, Vol. V: Theory of Heat, 
Engl, transl. H.L. Brose, Macmillan & Co., Ltd. 

Prigogine, I. (1967), Introduction to Thermodynamics of Irreversible Processes, 
3rd ed., Interscience Publ., NY. 

Prigogine, I. (1980), From Being to Becoming: Time and Complexity in the 
Physical Sciences, W.H. Freeman & Co., San Francisco, 1980. 

Schneider, E.D., Sagan, D. (2005) Into the Cool: Energy Flow, Thermodynam- 
ics and Life, University of Chicago Press, Chicago. 

Schrodinger, E. (1944), What is Life?, Cambridge U.P., Cambridge (see chapter 
6 and following Note). 

Shannon, C.E. (1948) A mathematical theory of communication. Bell Sys. 
Tech. J. 27: 379-423; 623-659. 

Strong, L.E., HaUiwell, H.F. (1970) An alternative to free energy for undergrad- 
uate instruction, J. Chem. Ed. 47(5): 347-352. 

Tribus, M. (1961a), Information theory as the basis for thermostatics and ther- 
modynamics, J. Appl. Mech., Trans. ASME, 28: 1-8. 

Tribus, M. (1961b), Thermostatics and Thermodynamics, D. Van Nostrand Co. 
Inc., Princeton, NJ. 

Vanyo, J.P., Paltridge, G.W. (1981) A model for energy dissipation at the 
mantle-core boundary, Geophys. J. R. Astron. Soc. 66: 677-690. 

Yoshida, Z., Mahajan, S.M. (2008) Maximum entropy production in self- 
organized plasma boundary layer: A thermodynamic discussion about tur- 
bulent heat transport. Physics of Plasmas 15: article 032307. 

Zupanovid, P., Juretid, D., Botri£, S. (2004)Kirchhoffs loop law and the maxi- 
mum entropy production principle, Phys. Rev. E 70: article 056108. 

Zupanovic, P., Botric, S., Juretic, D. (2006) Relaxation processes, MaxEnt for- 
malism and Einstein's formula for the probability of fluctuations, Croatica 
Chemica Acta 79(3): 335-338. 

Zwillinger, D. (2003)CRC Standard Mathematical Tables and Formulae, Chap- 
man & Hall / CRC Press, Boca Raton, FL. 



11 



